1 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
7 March 2002 (07.03.2002) 




PCT 



(10) International Publication Number 

WO 02/19724 Al 



(51) International Patent Classification 4 : H04N 9/07 

(21) International Application Number: PCT/USOQ/23670 

(22) International Filing Date: 28 August 2000 (28.08.2000) 

(25) Filing Language; English 

(26) Publication Language: English 

(71) Applicant: NITWAVE TECHNOLOGIES, INC. 

[US/US]; 1 Passaic Avenue, Fairfield, NJ 07004 (US). 

(72) Inventor: WEBB, Robert, I.; 198 Stanton Ml. Road, 
Lebanon, NJ 08833 (US). 



(74) Agent: ADAMSON, Steven, X; P.O. Box 5997, Portland, 
OR 97228 (US). 

(81) Designated States (national)*. JP, KR. 

(84) Designated States (regional): European patent (AT, BE, 
CH, CY, DE, DK, ES, FT, FR, GB, GR, IE, IT, LU. MC, 
NL, PT, SE). 

Published: 

— with international search report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



ON (54) Title: IMPROVED COLOR IMAGE DATA PROCESSING APPARATUS AND METHOD 

^ (57) Abstract: An apparatus and method for efficiently filtering or otherwise processing digital color image data. The invention 
niay be implemented in hardware, firmware or software. In one embodiment, the green color signal is filtered while the blue and red 
O color signal are not filtered. This results in less filtering circuitry and processing time, while retaining the sharpness of the unfiltered 
J> signals. Since the human eye is more sensitive to the color green, filtering this color produces the greatest amount of noise reduction 
^ per color. Alternative color and filtering arrangements are also disclosed as is file conversion logic. 



WO 02/19724 



PCT/US00/23670 



IMPROVED COLOR IMAGE DATA PROCESSING 
APPARATUS AND METHOD 



FIELD OF THE INVENTION 
The present invention relates to digital color image 
signal processing. The present invention is applicable 
to still-frame pictures and motion pictures. 

BACKGROUND OF THE INVENTION 
The advent of the Internet and improvements in 
computer technology ' have lead to more frequent 
transmission of color image data via computer networks 
and to the display of color images on computers or like 
devices. It is expected that the use of computers for 
displaying color image data and the need to enhance image 
quality will continue to increase, particularly as 
computers and like devices are used to display motion 
pictures . 

Various filter and image data processing 
circuits/logic have been developed to support advances in 
digital color image data processing* These 
circuits/logic include color, contrast, brightness and 
related circuits/logic* 

Color image data is typically generated by 
subjecting raw image data to a compression algorithm. The 
compressed data can, be more rapidly transmitted and/or 
more efficiently stored than non-compressed data. The 
compressed data is decompressed and interpolated for 
display. 
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During compression (and due to other causes), 
defects may be introduced into color image data. These 
defects often take the form of holes or graininess in a 
displayed image. Decompression and interpolation 

algorithms may also contribute to these defects. 

In an effort to reduce image defects and to 
generally improve image quality, color filter 
circuits/logic have been developed. In a parallel 
filtering arrangement, separate filters operate on each 
of the three primary color signals. This results in 
rapid processing, but necessitates a large amount of 
processing circuitry. In a serial filtering arrangement, 
each color signal is fed serially through the same filter 
circuitry. While serial arrangements decrease the 
requisite amount of circuitry by approximately two-thirds 
compared to parallel arrangements, serial arrangements 
increase processing time approximately three-fold. 

In addition to noise and defect reduction, filters 
also reduce the clar.ity or sharpness of an image. Thus, 
by filtering each of the color signals, a cumulative 
reduction in image clarity is produced. 

SUMMARY OF THE INVENTION 
Accordingly, it is an object of the present 
invention to provide filtering of color image data in a 
manner that requires less circuitry and/or processing 
time . 

It is another object of the present invention to 
achieve this filtering in a manner that causes less image 
clarity reduction. 

It is another object of the present invention to 
provide filtering of less than all of the primary colors 
of a color image data signal. 
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It is also an object of the present invention to 
provide filtering of the color or colors to which the 
human eye is most sensitive. 

These and related objects of the present invention 
are achieved by use of an improved color image data 
processing apparatus and method as described herein. 

In one embodiment, the present invention includes 
logic and/or a method for color image data processing in 
which the green color signal is filtered while the blue 
and red color signals are not filtered- The human eye is 
most sensitive to the color green. As a result, 
filtering this color produces the largest amount of 
recognizable noise reduction (or otherwise stated image 
quality enhancement) per primary color signal. By 
filtering only one of the primary colors (or less than 
all), the amount of processing circuitry and/or the 
amount of processing time is significantly reduced. 

Furthermore, by not filtering the blue and red 
components (or by not filtering at least one of these 
components), the sharpness contained in the unfiltered 
component is contributed to the final image signal. Thus, 
a reduced noise, sharper contrast signal from minimal 
circuitry and processing is achieved. 

It should be recognized that other primary color 
schemes (e.g. CMYK or YUV, etc.) may be utilized, without 
departing from the present invention' s teaching of 
filtering less than all of the primary color signal 
components, and preferably (but not necessarily) 
filtering the color or colors to which the human eye is 
most sensitive. It should also be recognized that while 
filtering one of the color signals is preferred, 
filtering more than one, but less than all is also within 
the present invention. 
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The attainment of the foregoing and related 
advantages and features of the invention should be more 
readily apparent to those skilled in the art, after 
review of the following more detailed description of the 
invention taken together with the drawings, 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig* 1 is a block diagram of color image data (CID) 
processing logic 10 in accordance with the present 
invention. 

Fig, 2 is a diagram of color signal filtering in 
accordance with the present invention, 

DETAILED DESCRIPTION 
The present invention includes the digital 
processing of color image data. Color image data may be 
processed in hardware, firmware and software. In a 
preferred embodiment, the present invention is 
implemented in software that is executed on a processor, 
such as the CPU or other processor of a computer. It 
should be recognized that aspects of the present 
invention may be implemented in firmware or hardware 
given the teachings herein, and these implementations are 
within the scope of the present invention. The term logic 
as used herein is intended to represent software, 
firmware or hardware implementations / embodiments . 

In the discussion that follows, red (R) , green (G) 
and blue (B) are discussed as the primary colors. It 
should be recognized that other color schemes (e.g., CMYK 
and YUV, and complementary color schemes, etc) could be 
utilized without departing from the present invention. 

Referring to Fig. 1, a block diagram of color image 
data (CID) processing logic 10 in accordance with the 
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present invention is shown. Block 12 represents a source 
of CID which may be a digital camera, a scanner, an 
Internet transmission, an image file in memory, etc. As 
alluded to above, CID is typically stored and/or 
transmitted in a compressed manner, though it is 
conceivable that CID may be provided in a non-compressed 
manner, for example, streamed directly out of a digital 
camera. 

Block 16 represents decompression and interpolation 
logic. Suitable decompression and interpolation logic is 
known in the art. 

Block 20 represents conversion logic (hereinafter 
referred to as "conversion logic 20") . Conversion logic 
20 converts the input CID to a common format. Examples of 
possible input formats include JPG, AVI, etc. A preferred 
common format is standard device independent bitmap (DIB) 
format. This format provides a one byte (8 bits) value 
for each of three primary colors, e.g., RGB (alpha data 
bits may also be provided as is known though they are not 
discussed here) . Accordingly, the output of conversion 
logic 20 is preferably a 24 bit signal that includes an 8 
bit pixel value for each primary color. 

It should be recognized that conversion logic 20 is 
preferably capable of converting other color signal 
arrangements, e.g., CMYK, etc., into an RGB arrangement. 
It should also be recognized that decompression and 
interpolation logic 16 may be integrated into conversion 
logic 2 0 such that compressed data is converted to DIB as 
it is decompressed. 

Block 30 receives the formatted CID (FCID) output 
from converter logic 20 and is representative of other 
processing logic. This may include logic that calculates 
an average pixel value and if that average is below a 
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certain threshold increases the value of all pixels by a 
certain offset* This provides automatic contrast 
adjustment. Other processing may include brightness and 
black level adjustment, etc* Logic for performing these 
5 and related functions is known in the art. 

The FCID is output from block 30 to color processing 
logic 40. Color processing logic 40 preferably performs 
filtering on the green color signal (or on less than all 
of the primary color signals as described in more detail 

10 below) . The filtered green color signal is preferably 
stored with the other color signals in bit map memory 
(processor RAM) 45. The filtered green color signal (or 
other color signal) and the unfiltered red and blue (or 
other color signals) are then output from color 

15 processing logic 4 0 for storage at memory 50 and/or for 
display via a display mechanism 60. Display mechanism 60 
may be any suitable display mechanism including/ but not 
limited to, a monitor, a printer, a projection system, an 
overhead, etc, 

20 As mentioned in the Summary above, the human eye is 

more sensitive to the color green than to the colors blue 
and red. Thus, by filtering the color green, the greatest 
amount of noise reduction per color signal is achieved . 
Furthermore, by filtering only one (or less than all of 

25 the primary colors), processing time and/or processing 
circuitry is significantly reduced. In addition, by not 
filtering the red and blue color signals, the sharpness 
contained in these signals is passed through to the final 
image . 

30 Referring to Fig. 2, a diagram of color signal 

filtering in accordance with the present invention is 
shown. Oval 102 denotes the start of processing. In step 
106, a file (a frame of FCID) is read in by the color 
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processing logic 40 (Fig. 1) . The header is examined to 
determine file size and type and to extract other known 
header information. Bit-mapped pixel data contains row, 
column and plane designations (e.g., pointers) as is 
5 known in the art. These are appropriately analyzed. 

In step 110, a filter matrix that points to an 
appropriate pixel (the "target" pixel) is established (or 
updated) . A three by three matrix is preferably 
established, although other matrix sizes may be utilized. 
10 Initially the matrix is set to point at the first green 
pixel and its surrounding pixels. Bitmap pointers are 
preset for pointing to this target pixel and the 
surrounding pixels to hence form the matrix. 

In step 114, the value of the target pixel is 
15 preferably compared to the mean of the target pixel and 
surrounding pixels. If the difference between the target 
pixel and the calculated mean is large (indicating an 
abrupt color change, i.e., an edge of a different item in 
the image) , then no filtering is performed and the 
20 process flow continues to step 118, where the next target 
pixel (e.g., green) is pointed to. If the difference 
between the target pixel and the calculated mean is not 
large, then in step 122, the value of the target pixel is 
changed to equal the mean value. This new pixel value is 
25 then stored to bitmap memory 45 (step 12 6) . 

In step 130, a designation is made as to whether the 
last pixel in the current frame has been processed. If 
no, processing returns to step 110 where the next target 
pixel is pointed to. If yes, processing of the color 
30 green for the current frame is complete (oval 134) . For a 
motion picture, the next frame is then loaded at step 106 
and processing proceeds from step 110. 



WO 02/19724 PCT/US00/23670 

- 8 - 

The filtering process described with reference to 
Fig. 2 may be described as a blur or low pass filter. 
More specif ically f the filtering process may be referred 
to as a x> smart blur" because it blurs or filters some 
pixels (those that have a value that is not significantly 
different from the mean) and does not blur other pixels 
(those that are significantly different) . A large 
difference indicates an edge and sharpness may be lost by 
blurring edges. The amount of selective blurring or 
filtering (or whether to exclude pixels at all) may be 
selected by the programmer that is implementing the 
filter program. Comparison based on average, minimum, 
maximum or other programming may also be utilized. 

While blur filtering is discussed above, it should 
be recognized that other types of filtering or processing 
may be achieved without departing from the present 
invention's teaching of processing less than all of the 
color signals and processing the color signal (s)' to which 
the human eye is most sensitive. 

It should further be recognized that since the human 
eye is more sensitive to the color blue than the color 
red, filtering blue and/or green and not filtering the 
color red reduces processing time and circuitry and 
achieves significant noise reduction, while preserving 
the sharpness in the red color signal. 

While the invention has been described in connection 
with specific embodiments thereof, it will be understood 
that it is capable of further modification, and this 
application is intended to cover any variations, uses, or 
adaptations of . the invention following, in general, the 
principles of the invention and including such departures 
from the present disclosure as " come within known or 
customary practice in the art to which the invention 
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pertains and as may be applied to the essential features 

hereinbefore set forth, and as fall within the scope of 

the invention and the limits of the appended claims. 
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CLAIMS 

1. A color image data (CID) improving apparatus, 
comprising: 

an input that receives digital CID that is comprised 
5 of a plurality of color signals/ each color signal being 
representative of a different color; 

color filter logic coupled to said input that 
filters the one of said color signals to which the human 
eye is most sensitive and does not filter another of said 
10 color signals; and 

an output coupled to said filter logic that outputs 
the filtered color signal along with the unfiltered color 
signal . 

15 2. The apparatus of claim 1, wherein said filter 

logic includes logic that performs blur filtering on said 
filtered color signal. 

3. The apparatus of claim 2, wherein said filter 
20 logic includes logic that performs smart blur filtering 

on said filtered color signal. 

4. The apparatus of claim 1, wherein said filtered 
color signal is representative of the color green. 

25 

5. The apparatus of claim 1, wherein said color 
signals include red, green and blue color signals and the 
green color signal is filtered and the red and blue color 
signals are not filtered. 

30 

6. The apparatus of claim 1, further comprising 
conversion logic coupled between said input and said 
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filter logic that converts an input CID file into a 
common format. 

7. The apparatus of claim 6, wherein said common 
5 format is device independent bitmap (DIB) format, said 

DIB format containing said plurality of color signals, 

8. The apparatus of claim 1, wherein said filter 
logic filters more than one and less than all of said 

10 color signals. 

9. A color image data (CID) improving apparatus, 
comprising: 

an input that receives digital CID that is comprised 
15 of red, green and blue color signals; 

color filter logic coupled to said input that 
filters said green color signal and does not filter said 
red and blue color signals; and 

an output coupled to said filter logic that outputs 
20 said filtered green color signal along with said 
unfiltered red and blue color signals. 

10. The apparatus of claim 9, wherein said filter 
logic includes logic that performs blur filtering on said 

25 filtered green color signal. 

11. The apparatus of claim 9, wherein said filter 
logic includes logic that performs smart blur filtering 
on said filtered green color signal. 

30 

12. The apparatus of claim 9, further comprising 
conversion logic coupled between said input and said 
filter logic that converts an input CID file into a 
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format that includes the red, green and blue color 
signals . 

13. The apparatus of claim 12, wherein said common 
format is device independent bitmap (DIB) format. 

14. A method of improving color image data (CID), 
comprising the steps of: 

receiving digital CID that is comprised of a 
plurality of color signals, each color signal being 
representative of a different color; 

color filtering the one of said color signals to 
which the human eye is most sensitive and not filtering 
another of said color signals; and 

outputting the filtered color signal along with the 
unfiltered color signal, 

15. The method of claim 14, wherein said filtering 
step includes the step of blur filtering said filtered 
color signal. 

16. The method of claim 14, wherein said filtering 
step includes the step of smart blur filtering said 
filtered color signal. 

17. The method of claim 14, wherein said filtering 
step includes filter a green color signal. 

18. The method of claim 14, further including the 
step of converting received CID into a common format 
before filtering. 
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